On curvature and feedback classification of 
two-dimensional optimal control systems 

Ulysse Serres* 



Abstract 

The goal of this paper is to extend to two-dimensional optimal con- 
trol systems with scalar input the classical notion of Gaussian curvature 
of two-dimensional Riemannian surface using the Cartan's moving frame 
method. This notion was already introduced by A. A. Agrachev and 
R. V. Gamkrelidze for more general control systems using a purely varia- 
tional approach. Then we will see that the "control" analogue to Gaussian 
curvature reflects similar intrinsic properties of the extremal flow. In par- 
ticular if the curvature is negative, arbitrarily long segment of extremals 
are locally optimal. Finally, we will define and characterize flat control 
systems. 

1 Introduction 

In Riemannian geometry the Gaussian curvature of a manifold reflects intrinsic 
properties of the geodesic flow, i.e. properties that do not depend on the choice 
of local coordinates. For example, the geodesies of the surface have no conjugate 
points if the curvature is non-positive. Indeed, these geodesies are extremals of 
a particular time optimal control problem the dynamics of which is given by 

q = cos u ei (q) + sin u e-i (q) , u G 5, 

where (ei, e%) forms an orthonormal frame of the Riemannian structure on the 
manifold. Our goal is to generalize the classical notion of Gaussian curvature 
of two-dimensional Riemannian surfaces for two-dimensional smooth optimal 
control problems. The notion of curvature tensor for non linear optimal control 
problems was first introduced in by A. A. Agrachev and R. V. Gamkrelidze 
with a purely variational description by means of Jacobi curves, which are curves 
in the Lagrangian Grassmannian. Here we will not deal with Jacobi curves but 
use the Cartan's moving frame method in order to construct a feedback invariant 
frame associated to our optimal control problem and provide a less general but 
also more geometric definition of the curvature function. 
Consider a control system of the form 

q = f(q ,u), qeM, u E U, (1.1) 
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where M and U are smooth connected manifolds. Let f(q,u), (q,u) E M x [7, 
be the right-hand side of another such system. We say that the two systems are 
feedback- equivalent if there exists a diffeomorphism 9 : M x U — > M x U of the 
form 

Q(q,u) = (<f>(q)^(q,u)) (1.2) 
which transforms the first system to the second, i.e. such that 

T q cj>{f{q,u)) = f{4>{q)^{q,u)). 

In the above diffeomorphism 4> plays the role of a change of coordinates in the 
state space M, and tp called pure feedback transformation reparametrizes the 
set of controls U in a way depending on the state variable q € M . Our aim is 
to provide feedback invariants for control system H1.I|) when the manifold M is 
of dimension two and the control set U of dimension one what we suppose from 
now. 

In this case, if the coordinates on the manifold are fixed, a control system 
of type is parametrized by two functions of three variables, and the group 
of feedback transformations of type l|1.2|l is parametrized by two functions of 
two variables and one function of three variables. Therefore, we can a priori 
normalize only one function among the two functions defining control system 
(|f .1(1 . Thus, we expect to have only 2 — 1 = 1 "principal" feedback invariant, 
i.e. a function of three variables, in this equivalence problem. 

All results of the present paper will be presented without proof. Anyway, 
most of these proofs can be found in the references cited at the end. 

2 Curvature 

Suppose that we want to minimize an integral cost J^ 1 (f(q, u)dt, along the tra- 
jectories of control system (|l.lll . We write the normal maximized Hamiltonian 
function of PMP (Pontryagin Maximum Principle) which is defined by 

h(\)=wax((\,f(q,u))-<p{q,<u)), A S T*M, q e M, (2.1) 

where (• , •) denotes the canonical pairing between the tangent and the cotan- 
gent bundles over M. Hamiltonian h is a function on the cotangent bundle 
T*M which is, because of being independent of u, feedback- invariant. Thus, 
all objects construct from Hamiltonian h through intrinsic relations will also 
be feedback invariants. As usual, if a denotes the symplectic two-form of the 
cotangent bundle over M, we define, via the relation <r(-,h) — dh, the Hamil- 
tonian vector field h associated to the Hamiltonian function h. Assume that 
ft, is a smooth function, then the corresponding Hamiltonian vector field h is 
well-defined and tangent to the level set of h. PMP asserts (see e.g. 0) that 
optimal trajectories of system (11.11) are projections onto M of trajectories of the 
Hamiltonian system A = h(X), in other words trajectories of Hamiltonian field 
h are extremals of our optimal control problem. Now fix a level set Ti = /i _1 (e) 
of our Hamiltonian, then the intersection H q = H<~)T*M is a curve in the plane 
T*M and under the regularity assumptions 

df(q.u) , df(q.u) d 2 f(q,u) 
f(q,u)A -T' V O, a A J Vq ; ' >0, qeM, u e U, (2.2) 
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such a curve is a strictly convex curve surrounding the origin and it admits, up 
to sign and translation, a natural parameter providing us with a vector field v q 
on Tt q and by consequence with a vertical vector field v on Ti. Vector field v 
is characterized by the fact that it is, up to sign, the unique vector field on Ti 
such that 

Lis = -s + bL v s, (2.3) 

where s denotes the restriction to Ti of Liouville one- form "pdq" of T*M and b 
is a smooth function on the level Ti. 

Actually function b is the feedback invariant of our control system that 
characterizes Riemannian problems. Namely control problem (|X . 1|> defines a 
Riemannian geodesic problem if and only if the invariant b is identically equal 
to zero. 

Since vector fields h and v are feedback-invariant, it is natural to think that 
the curvature of our system may arise from a commutator relation of these fields. 
Indeed, the following theorem confirms this intuition. 

Theorem 2.1. Vector fields v and h satisfy the following nontrivial commutator 
relation: 



h. 



v, h 



(2.4) 



Proof of this theorem can be found in 0, 0]. The coefficient k in the identity 
(|2.4(l is defined to be the curvature of our optimal control problem and since the 
fields h and v are feedback-invariant, the curvature k is also feedback-invariant. 
Fix a system of local coordinates A = (0,q) G Ti where 9 parametrizes the 
i q so that v = -^g and denote J| 



fiber Ti q so that v = -Sg and denote -jL = ' ■ Define the function c = c{9, q) by 



d q s = cs A s', (2-5) 

where d q s is the differential of the Liouville one- form s with respect to the 
horizontal coordinates. Then, the Hamiltonian field takes the form 

and the curvature k is evaluated as follows: 

K{6,q)=L K ,c-L % c l . (2.6) 

Example 2.2. Consider the control system corresponding to the geodesic prob- 
lem on a two-dimensional Riemannian manifold: 



<l 



cos u ei (q) + sin u e 2 (q) , u S S . (2.7) 



In this case, control curvature k is the Gaussian curvature of the Riemannian 
manifold M and it is evaluated as follows: 

n{q) = -c\ - c\ +L ei C2 - L e3 ci, (2.8) 

where ci, c 2 are the structural constants of the orthonormal frame (ei,e2) on 
M: 

[ei,e 2 ] =ciei+c 2 e 2 , ci, c 2 G C°°(M). 
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See P] for the proof of this formula. Of course, for the Riemannian problem 
the curvature k = re(g) depends only on the base point q 6 M as one can see 
from formula l|2.8|) but in general this is not the case: the curvature n depends 
also on the coordinate in the fiber H. q and thus is a function on the whole 
three-dimensional manifold Ti. 

Observe that relations 1)2. and l|2.4(l define two feedback invariants: the 
function b and the curvature n. Both b and n are functions on the three- 
dimensional level surface Ti., so that they are principal feedback invariants of 
our control system. Since our feedback equivalence problem admits only one 
invariant these functions are not "independent" . Indeed invariants b and k are 
connected by the following differential relation: 

L v K + bK + Lf.b = 0, (2.9) 

which can easily be derived calculating some bracket relations between vector 
fields v and h. In particular, relation (|2.9|l shows that in the special case of 
Riemannian problems, the curvature n is a function on the base manifold M 
without any computation. Indeed, since Riemannian problems are characterized 
by the vanishing of function b, (|2.9(l reduces to L v n = 0. 

3 Jacobi equation 

It is easy to see that the regularity assumptions (12.21) imply /iAwA[h,«]^0so 
that vector fields h, v, [h, v] form a moving frame on the level surface Ti. In this 
section we use this moving frame to derive an ODE on conjugate time of our 
two-dimensional optimal control problem. This ODE, Jacobi equation in the 
moving frame, will show that the control curvature analogue to the Gaussian 
curvature enjoys similar properties. 

Fix a point qo £ M and define a two-dimensional surface in Ti. by: 

4 = e* S (W go ), feR, 

where e* denotes the flow of the Hamiltonian field h. The surface Cq is the 
lift in the cotangent bundle of trajectories 1 1— ► q(t) in M of control system (II. 1|) 
with starting point q(Q) = qo. We say that a point q = q(t), t ^ 0, is conjugate 
to qo (or time t is conjugate to zero) if q is a critical value of the canonical 
projection 

vr : 4 -► M. (3.1) 

It is easy to check that the tangent space T\£q, X € Cq, is spanned by the 
vectors h(X) and (el h v)(X) so that the point q(t) = n(X) is conjugate to q if 
and only if 

(e*/t>)(A)espan(£(A),«(A)) • 
Consider the decomposition of the vector field e^v in our moving frame on Ti.: 



el h v = a {t)h + (3(t)v + j(t) 
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It turns out that coefficients a(t), f3(t), j(t) are solutions to the Cauchy problem 
a\ /0 \ / a\ 

= Kt \\P }, a(0) = l, 0(0) = 7(0) = 0, (3.2) 

.7/ \o -i o y Vt/ 

where K t = K(e th (A )), 7r(Ao) = go- It is quite obvious that Cauchy problem 
(|3.2I) is equivalent to the second order linear ODE, called Jacobi equation 

7 + Kt7 = 0, 7 (Q) =7 ( t) = , (3.3) 

where n t = K,(e th (Ao)). Thus an instant t is a conjugate time for our optimal 
control problem if and only if there exists a non trivial solution to the boundary 
value problem (|3.3[1 . Using the Sturm's comparison theorem for second order 
ODEs one can prove the following theorem about the occurrence of conjugate 
points for system 

Theorem 3.1. Let q(t), q(0) — qo, be a solution of an optimal two-dimensional 
control problem and let Kt be the value of the curvature along an extremal X(t), 
n(\(t))=q(t). 

(i) If K t ^ for all t ^ 0, then qo has no conjugate points for t £ [0, +oo]. 

(ii) If Kt ^ Ki (resp. K t < K\) for all t 0, and some constant k\ > 0, 
then qo has no conjugate points along q(-) for t £ [0,tt / y/K~i[ (resp. for 

(in) If < Ko ^ Kt (resp. < ko < Kt), for all t 0, then qo must have at 
least a conjugate point for t S ]0, -k / ^/~ko ] (resp. for t £ ]0, tt/^/kq [). 

The following theorem gives sufficient condition for a trajectory q(t) on M to 
be strongly locally optimal in terms of conjugate points (see for the definition 
of strong optimality and the proof of the following theorem) . 

Theorem 3.2. Let the trajectory q(t) be as in theorem \3.1\ If the time inter- 
val ]0,ti] does not contain conjugate points, then the trajectory q(t) is strongly 
locally optimal for t £ [0, t\] . 

On the other hand if an instant t c £ ]0, t{\ is conjugate to zero, then there 
exists an instant t £ ]0,ii] where the trajectory q(t), t £ ]0,ii], ceases to be 
locally optimal. 

Example 3.3. Zermelo navigation problem (see |3] for a detailed description). 
This problem is a time optimal control problem which consists of finding the 
quickest nautical path of a yacht in the presence of stationary sea currents. 
The sea surface is modeled by a two-dimensional Riemannian surface M and 
the currents by an autonomous vector field X £ VccM. Dynamics of optimal 
trajectories for Zermelo problem are given by 

q = X(q) + cosu ei + sin it e.%, q £ M, u£S 1 , 



where (ei, e.-i) form an orthonormal frame of the Riemannian surface M . Sup- 
pose that the manifold M is the Euclidean plane R 2 . Then, in the coordinate 
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system (qi ,q 2 ,u) vector fields h and v read 

h = (Xi + cosu)^- + (X 2 + sinu)^- - (D„X(- sinu ), ( cosu ))-^-, 

V 1 / pi n 1 v z i i q \ y V cos ul ' Vsin uJ I 1 
Q 

v = JXi{q) cosu + X 2 (q) sinu + 1 — , 

ou 

so that one can compute the curvature using formula (|2.4|) (here, (•, •) denotes 
the scalar product between vectors) . If we suppose moreover that the drift term 
is the linear field X(q) = (_? *)q then, the control curvature for this problem 
is k = — a 2 /4 (see 0]) and theorem 13. II thus implies that there is no conjugate 
point along trajectories. The following theorem can also be proved using the 
definition of conjugate points. 

Theorem 3.4. There is no conjugate point for Zermelo navigation problem on 
R 2 when the drift term X is a linear vector field. 

Let us sketch the proof of this result (see 0] for the detailed proof). Since the 
drift term is linear, it is easy to compute the map it (see (|3.1|) for the definition) 
which takes the form: 

tt(Mo) = q(t,qo,u ) = e tA q + J* e^ A dr, 

where A is the matrix representation of the linear drift term. Now, because 
the Hamiltonian flow preserves the Liouville one-form, it is easy to see that the 
differential d( tjtl0 )7r is of maximal rank if and only if d Uo ir is of maximal rank. 
Saying this, it is now an easy task to find a vector v such that d Uo ir(v) =/= 
which completes the proof. The above theorem is also valid on R™ where the 
Zermelo navigation problem can be generalized without any difficulty; the proof 
is also similar. 

4 Flat systems 

In Riemannian geometry it is well-known that if the Gaussian curvature of 
the surface is nonzero then, one can not rectify simultaneously the geodesies 
by a change of coordinates. Only Riemannian flat systems, i.e. systems for 
which the geodesies are "straight lines" have this property. For control systems 
the situation is quite different first of all because control systems with zero 
curvature are not necessarily flat. We present here a new theorem which gives 
a characterization of flat control systems in terms of the feedback invariants k 
and b. We begin with the following definition. 

Definition 4.1. A control system q = f{q,u) is said to be flat if it is feedback 
equivalent to a control system of the form q = f(u). 

It is obvious that a flat system has zero curvature but the contrary is in 
general not true. For example a Zermelo problem defined on the Euclidean 
plane IR 2 with a nonzero linear drift term is never flat. 

Suppose that a control system satisfies 



L R b = 0. 



(4.1) 
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The above property implies in particular that the plane curves TL q <zT* M are all 
of the same centro-affine length. Control systems of this type are very peculiar 
and have nice geometric properties that we do not discuss here. However such 
systems with zero curvature are characterized in the theorem below. 



Theorem 4.2. There exists a feedback transformation such that: 

<■>«>• ^ 



(4.2) 



if and only if the feedback invariants k and Ljh are identically equal to zero. 
Moreover if we fix local coordinates q = (91,92) in M, then these systems can 
be parametrized by a one-parameter family of diffeomorphisms generated by the 
vector field: 

d d 

X u = (ai(u) + q 2 ) ^ h (a 2 (u,q 2 ) - • (4.3) 

oqi oq 2 

In the above theorem if u is a control parameter such that the fields / and ^£ 
commute then, vector field X u is the infinitesimal generator of a diffcomorphism 
P u S Diff M such that 

'-(«-).^)- (0) •(!))■ 

Notice that commutativity between vector fields / and ^ is not a feedback- 
invariant property. When the curvature is identically zero the above theorem 
shows that the PDE 14.1(1 can be reduced to the nonautononous ODE 

The following theorem characterizes flat control systems. 

Theorem 4.3. A control system of type 11. 1\) is flat if and only if its feedback 
invariants n, L^b and L, j^b vanish identically. 

We do not discuss in detail proofs of theorems 14.21 and 14.31 in this paper 
but we roughly explain the main ideas. The proofs are based on the following 
differential equation which can easily be derived from the differentiation of the 
structural equations of our feedback invariant moving frame on TL: 

c" + bc' + c = L n b, (4.5) 

where c is the function defined in 1(2.5(1 . It follows immediately from this equa- 
tion that if a control system is such that 1(4. 2(1 holds (respectively if a control 
system is flat) then, its feedback invariants n and L^b (respectively k, L^b and 
L, v j^b) vanish identically. To prove the converse observe first that if a control 

system has zero curvature then, the vector fields h and [v, h] commute so that 
the choice of a natural parameter 9 on the fibers 7i q defines a foliation of Tt, the 
leaves of which are formed by the trajectories of the fields h and [v, h]. Now, 
choose the parameter 8 (recall that this natural parameter is fixed only up to 
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transformation of the form 9 t— ► ±8 + (f>(q)) so that c becomes zero which is pos- 
sible since c satisfies equation (|4.5|l with L^b = 0. This shows in particular that 
there exists a feedback transformation so that (|4.2I) holds and by the Frobenius 
theorem one gets the existence of a diffcomorphism P u £ Diff M such that (|4.4(l 
holds. In order to get the expression 1)4. 3|1 we use Moser's argument for which 
the key idea is to determine the diffeomorphisms P u by representing them as 
the flow of a family of vector fields X u on M . We thus suppose that 

^^ti = X u o P u , P Uo = Id, 

and the expression of X u in coordinates follows from differentiation with respect 
to u of 14.4J1 . This complete the proof of theorem !4.2l In order to complete the 
proof of theorem 14.31 one has just to check that L^b = and L, — imply 
that b = b{u) which, in addition with (|4.2|) and k — easily implies that the 
system is flat. 

We now conclude our discussion with the following example. 

Example 4.4. Consider Zermelo navigation problem as in example 13.31 One 
can prove that this problem is flat if and only if the Ricmannian surface M is 
fiat and the drift term X is constant. 
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